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SIMULATED TRAINING METHOD USING 

PROCESSING SYSTEM IMAGES, 
IDIOSYNCRATICALLY CONTROLLED IN A 
SIMULATED ENVIRONMENT 

RELATED APPLICATION 

This application is a continuation of U.S. patent applica- 
tion Ser. No. 08/684,435, filed on Jul. 19, 1996, now U.S. 
Pat. No. 5,890,906 which is a continuation-in-part of U.S. 
patent application Ser. No. 08/375,616, filed on Jan. 20, 
1995, now abandoned, and a continuation-in-part of PCT 
International application Ser. No. PCT/US96/00919, filed on 
Jan. 22, 1996, both of which are incorporated herein in their 
entirety by reference. 

BACKGROUND OF THE INVENTION 


25 


Technology that has been designed for sports and other 
activities involving motor skills is generally dedicated to 
improving strength, swing, motion, balance, speed, and 20 
agility. Accordingly, for golf and other sports, swinging 
motion trajectory is emphasized. For the most part the focus 
has been on developing aids for the individual athlete to 
improve a particular physical skill. Relatedly, technology for 
hazardous or potentially jeopardizing work, such as airplane 
piloting, is generally directed to practice in a simulated 
environment. In both areas mentioned above (motor skills 
and dangerous or jeopardizing work) the emphasis is on the 
individual taking action, i.e., making movements that imi- 
tate real circumstances. The prior art related to sports and 
physical actions is generally aided by technology directed to 
biomechanics and locomotion, i.e., to executing motor 
skills. 

There is little technology that is used for instruction or 
simulation in playing sports such as ice hockey. Common- 
place instructional aides include stopwatches, plastic orange 
cones (used for skating drills), parachutes (pulled to increase 
leg strength), 2 ,, x4" boards (used for jumping in agility, 
speed, and balance drills), and surgical tubing harnesses (to 
increase strength and force the skater to skate while bent 
forward at the waist). None of the devices noted above 
provide the student with instructive and cognitive informa- 
tion concerning principles, tactics, maneuvers, skills and 
strategies used in physical activities such as playing ice 
hockey. In addition, these devices do not enable the player 
to receive quantitative feed-back concerning his/her 
progress in learning and mastering the cognitive aspects of 
the sport. 


In one embodiment, as the program executes, an instruc- 
tive or ideal image displays the preferred style, technique, 
posture, procedure, skills, drills, positions, maneuvers, 
tactics, strategies or plays of any activity that calls for using 
S cognitive and motor functions. The user's cognitive func- 
tions are developed and/or improved by viewing the proce- 
dural methods used by an instructive or ideal image, shown 
on a portion of the screen. As the program further executes, 
the user's level of comprehension improves by: (1) receiving 
10 information and cues from visual, audio, textual and tactile 
transmissions, (2) visualizing the actions of the instructive 
or ideal image, (3) making cognitive choices and decisions 
as to what manipulations should be made, and then (4) 
manipulating a user controllable, adopted (by the user) 
15 image on another portion of the screen so as to cause the 
adopted image to simulate or approximate the prefened 
style, technique, posture, procedures, skills, drills, positions, 
maneuvers, tactics, strategies or play of any activity repre- 
sented by the instructive or ideal image. 

Alternatively, using the method and apparatus of the 
present invention, the user learns or is entertained by 
manipulating the controllable, adopted image(s) on a full or 
partial screen in competition against one or more instructive 
or ideal images or against other controllable images. 

The present invention can use, for either the instructive or 
ideal image, or for the adopted, controllable image, or for 
both, images from live video taping, or animated or com- 
puter generated images or live, or robots real time images. 
It will be apparent to those skilled in the art that the 
instructive image(s) can teach at any level of expertise from 
first time beginners to professional experts. Feedback can be 
provided to all uses . 

One embodiment pertains to a method of instruction in ice 
and roller hockey. More particularly, the embodiment per- 
tains to a tutorial and interactive method for self and directed 
instruction and simulated training and play in a sport (or 
other activity) such as ice or roller hockey including, but not 
limited to, the principles of skating, stickhandling, shooting, 
checking, offensive and defensive play, positional and situ- 
national play, tactical and strategic plays and maneuvers. 
f- TTie present invention includes observing an instructive 
' (or ideal) way of doing something, receiving information 
and visual, audio, textual and tactile cues, visualizing what 
needs to be done and manipulating the adopted image to 
make sequential, positional changes pursuant to reviewing 
objectives and options and making choices in a dynamic 
decision process. This is a cognitive and to some extent a 


35 


40 


SUMMARY OF THE INVENTION 


The present invention provides a method and an apparatus 
for interactive, tutorial, self and assisted instruction and 
simulated preparation, training and competitive play and 

entertainment directed toward improving comprehension, ___ 

exercising cognitive functions and providing amusement. ^Wimulate 
The method and apparatus provide for user interaction with By vi; 
images on the screen of a computer monitor, or other 
viewing device, containing multimedia, interactive, 
reconfigurable, audio -visual, tacticle systems. 

The present invention provides a user with the opportu- 
nity to engage in simulated training or game playing com- 
prised of instructive or ideal images and/or adoptable, con- 
trollable images. Such images provide the means by which 
the user can come to understand what to do using his/her 
cognitive and visualization skills. The use of such skills 
typically precedes the use of motor or motion skills. 


motor process that prepares the individual to engage in an 
< 0 activity coupling cognitive with motor skills. The present 
invention provides a simulated environment within which to 
prepare. The present invention combines perceptual experi- 
ence and cognition with physical sensation and uses cues to 
facilitate user trial, error and improvement. The present 

^invention facilitates the acquisition of accelerated albeit ^ 

*~ulated experience. 

virtue of the facility available to users of the present 
invention, simulated training can be accomplished as well as 
simulated drill and maneuvers in taking up proper positions, 
reacting to situational play and executing tactics and strat- 
egies. Further, without a requirement for actual imitative 
movement of an instructive figure or its movement and 
without the requirement to use actual tools, implements or 
equipment, users of the present invention can engage in 
simulated repetition and/or competition geared to either 
learning or entertainment and can do so within the economy 
of space used for a computer monitor and keyboard or other 
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economical, including virtual reality, input devices, (as 
shown in FIGS. 25 and 26). 

The present invention provides facilities for users to 
engage in simulated training, repetition and entertainment in 
activities that couple cognitive and motor skills. Such 
facilities, using skating as an example, include a range of 
functions such as simply understanding proper positioning 
for "pushing off' (for example, starting from a stationary 
standing position while on ice) to sophisticated, preferred, 
proactive play and preferred reactive play in response to 
numerous and varied competitive situations. The present 
invention, by virtue of its capacity to simultaneously present 
pre-programmed images following a predetermined system 
of activities and/or images that are controllable adopted by 
the user also provides for engaging entertainment and 
amusement. 

Using any form of communication of information, includ- 
ing but not limited to floppy disks, CD-ROM disks, a local 
network, the Internet or wireless communication, users can 
compete against single opponents, against prior stored 
images of any individuals (or animations), including them- 
selves or robots and against a full or partial opposing team, 
group or force. The elements of use of the present invention, 
including but not limited to viewing preferred or opposing 
activity, visualizing what the user should do in response to 
the activity viewed, including identifying options and mak- 
ing choices and decisions and interacting with the present 
invention through adoptable, controllable images open up a 
host of imaginative applications and uses for teachers, 
coaches, trainers, game players and the general public. 

An alternative embodiment of the present invention is to 
have dynamic interaction among all images on the screen so 
that users may adopt and control all images in a learning, 
competitive or entertainment oriented environment. 

The present invention is particularly well-suited to pro- 
viding to the user accelerated experience through simula- 
tion. The processes of observation, orientation, and judg- 
ment are facilitated by the present method and apparatus. 

The present invention is not limited to visual sensors but 
can incorporate others including audio etc. as needed. The 
use of auditory, visual and other cues decreases distractions 
and improves comprehension. Using the present invention 
as a relatively economical training simulator, implementa- 
tion of visualization in a simulated environment is facili- 
tated. Utilizing pre-programmed, automated and/or user 
controllable images, the users 3 awareness of spatial relation- 
ships among and between images, objects and locations is 
enhanced. Dynamic interaction between the images adopted 
by users, acting in concert as teammates against opposing 
images as well as dynamic communication and coordination 
by and between users, whether athletes or not, and other 
users is also enhanced. 

There are multiple opportunities to change the position of 
an individual or one's entire team, i.e. a group of adopted, 
controllable images in response to opposing positioning or 
formations. This can be accomplished using touch sensitive 
screens or other input devices and will lead to sharpened 
pre-training in individual and/or team technique. The 
present invention is applicable to activities other than sports 
and pastimes. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In the drawings, like reference characters generally refer 
to the same parts throughout the different views. Also, the 
drawings are not necessarily to scale, emphasis instead 
generally being placed upon illustrating the principles of the 
invention. 


FIG. 1 is a block diagram of a computer software system 
constructed according to the present invention. 

FIGS. 2A-2E contain flowcharts of the logical flow of the 
system of the present invention for preparation, processing 
5 of and interaction with video images. 

FIG. 3 is a pictorial diagram of a user interacting with one 
embodiment of the invention. 

FIG. 4 is a pictorial diagram of a user interacting with an 
10 alternative embodiment of the invention. 

FIGS. 5A and SB contain pictorial diagrams of two users 
interacting with another alternative embodiment of the 
invention, 

FIG. 6 is a pictorial diagram of multiple users interacting 
15 with another alternative embodiment of the invention. 

FIG. 7 is a pictorial diagram of multiple users interacting 
with another alternative embodiment of the invention. 

FIG. 8 is a schematic pictorial diagram of another alter- 
native embodiment of the invention used in conjunction with 
20 the worldwide Internet. 

FIGS. 9-32 are the pictorial diagrams of a user interacting 
with different embodiments of the invention. 
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DETAILED DESCRIPTION OF THE 
INVENTION 

One embodiment of the present invention provides a 
computer-based system for tutorial and interactive instruc- 
tion in the sport of ice (or roller) hockey including, but not 
limited to, the principal activities of skating, stickhandling, 
shooting, checking and offensive and defensive play, posi- 
tional and situational play, tactical and strategic plays and 
maneuvers. The system of the present invention is particu- 
larly well suited for use as a tutorial, selfotudy or assisted 
study aide and as a cognitive primer for performing the 
principal activities noted above. The system is also particu- 
larly well suited as an aid to instructors, trainers, coaches 
and officials or trainees at all levels of expertise. 
^'Physical activities such as playing ice hockey (or roller*" 
hockey) can be hazardous. As with other hazardous or 
demanding endeavors, t he practice of simula ted action nr tjie 
approximation of preferred action before actual execution is 
advisable. The use of computer assisted technology to 
enhance the amount of time to engage in simulated practic e 
45 can be distinctly advantageous to the user's (the "pla yer/ 
student's") knowledge base. Unlike video ancf arcade Raines 
etc., which do not enable the game player to initiate or react 
t o the actual dynamics of the real game, t he present inven- 
tion re q uires the player/student to review options, mak e 
5q Unices and decisions and to cause the movem ent of an 
adopted, controllable image (in the form of, for example, a 
hockey player) as though he/she were in an actual game. 

In the present invention the player/student is involved 
with hands-on, head-in activity, making actual choices and 
5 decisions and causing actual change of on-screen images in 
a virtually real environment under virtually real conditions. 
This type of control and initiative and the relev ancy and 
accura cy of the simulation and the teedbacic, lead tu »«cher 
(rooust; teaming experience. Accordingly, the present 
invention also relates to a variety of sub-components of the 
principle activities noted above, such as, agility, balance, 
impact/contact, timing, and "read and react" skills. 
^/ The computer system of the present invention enables the 
player/student to see and hear (on a computer screen or other 
65 device) how a particular skating, stickhandling, checking or 
other skill or drill can be performed (as shown in FIGS. 16 
and 17). The player/student, by observing an instructive or 
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ideal image of the skill being performed, is presented with see how the skill or play can be executed as a dynamic whole 

a clear example (as shown in FIGS. 11, 31 and 32). The (either in slow motion or actual speed) or can pick apart the 

player/student can then interact with the system by visual- skill or play by viewing images frame by frame (as shown 

izing the example shown and actually cause an on-screen in FIG. 19). The latter method enables the student to see 

adopted image to perform the skill or drill by approximation. 5 details of the ideal maneuver which might not be apparent in 

Feedback on the user's individual performance in compari- a moving image, 

son to the instructive or ideal pattern is visible in real time. The player/student is able to learn each skill at his/her 

Since feedback occurs in real time in the invention and since own pace. Since images can be moved frame by frame and 

proficiency scores are posted on screen at the end of each repeated as many times as desired, the player/student will be 

drill, the invention may be used by anyone. Feedback can 10 able to perfect his/her understanding and performance of 

also be delayed and/or printed out in hard copy or distributed e ach skill. Repeating each maneuver will improve recollec- 

by other means. ti on 0 f WDa t has been learned. 

For each preferred style, technique, posture, maneuver, Feedback can be received in real time by the player/ 

position, tactic, skill, drill or play of any activity, the student as he/she is able t o,see on the computer screen how 

computer system of the present invention can provide an ^ closely the a dopt ed ™ntm] l a hle. imape a pproximates ib e 

animated or digitized image of a player (or players) who Seal imager fasshown in FIG. 12V In addition, the inven- 

performs the instructive or ideal performance (example). tion can prov ide means to numerically evaluate the player/ 

The instructive or ideal performance can be accompanied by student's ability to match the sequential positional changes 

textual and/or auditory tutorials. For some purposes the an d maneuvers of the ideal image. The quantitative evalu- 

lesson may end at that point. For other purposes an inter- 20 ation wiU make it possible for the studenl t0 monitor his/her 

active instruction can follow and for still other purposes a progress in performing the skill, play or tactic each time it 

competitive or amusement scenario will ensue. practiced. 

The interactive session can call upon the player/student to Benefits to instructors include consistency and objectivity 

cause his/her adopted animated or digitized image(s) to in the information given to each player/student. Each player/ 

execute maneuvers under the direction of the player/student. 25 student will receive the same information and will be able to 

The present invention may use the ideal skater as is or may repeat the lesson or "game" until sufficient comprehension is 

transform an animated or digitized ideal skater into an acquired. Since player/students will be able to use the 

anatomical outline and provide that the outline have super- present invention independently, staff time can be quantita- 

imposed upon it or set beside it an "adopted" silhouetted tively and qualitatively enhanced. Instructors and students 

figure which will make sequential positional changes at the will be able to select areas for more or less concentration and 

direction of the player/student (as shown in FIGS. 9 and 29). repetition, including what should be done in actual practice. 

This calls upon the player/student to understand the posi- Use of the present invention will also be of benefit if access 

tional changes including the physical movements that are to ice hockey rinks is limited or, conversely, more can be 

required by the maneuver and to strive to have his/her made of available ice time. Accident or injury reduction can 

adopted image make those movements and sequential posi- result from increased awareness of dangerous situations or 

tional changes (as shown in FIGS. 20 and 30). conditions. 

Since this interactive game can be played by pitting the An additional embodiment of the invention enables offi- 

adopted controllable image against the instructive or ideal cials (referees, linesmen, and other officials) in the sport of 

image example, the difference between the execution by the 4Q ice hockey or in other sports or activities to practice posi- 

player/student controlled image and ideal execution can be tioning and making decisions regarding infractions of the 

measured. Auditory and/or textual prompts can be given in rules while watching and controlling digitized images on a 

real time as well as a score registered at the end of the computer screen (as shown in FIG. 10). The digitized images 

exercise. For any given (predetermined) skating step, stride include preselected plays or maneuvers executed by a single 

or maneuver, the player/student will have positive or nega- 45 player against one or more opponents or by a player in 

tive feedback in both audio and visual form based on his/her combination with one or more of his/her teammates playing 

ability to cause the controllable adopted image to appro xi- against an opposing team including one or more players or 

mate the drill being displayed. Advancements to the next actions taken by team coaches, managers and others, 

higher level or repetition for correction are integral parts of The officials view the execution of the play, while moving 

the invention. 5Q an "adopted" official, in digital form, to the best vantage 

The applications of such instruction are numerous. Player/ point from which to see the plays, and decide whether the 
students will learn what they will be called upon to do on the actions of the player or players or coaches are within the 
ice. The opportunity for self-drill and repetition is excellent. rules of the game or constitute an infraction of the rules for 
Mental preparedness can be enhanced. Uniformity and which a penalty is levied. The invention enables officials to 
economy in coaching and instruction can be enhanced. A 55 record their decisions in the computer system, 
lesson can be designed in advance, as can game plans. The digitized images can be obtained from video tapes of 
Computer usage (if not literacy) can be a learned by-product. uve athletes playing ice hockey or from animated or corn- 
Certain principles of geometry and physics can be learned in put er generated or robotic sources. Appropriate sections of 
conjunction with understanding how efficient and effective the video tape or other images can be selected and converted 
execution of skills leads to enhanced results. For example, 60 to or maintained in digitized format. The selected images 
how tighter turns shorten the distance between present can be viewed on a computer screen. Officials are able to 
location and desired positions on the ice or how good spee d up or slow down the images as they appear on the 
balance, timing and form lead to increased skating speed and screen. Alternatively, the speed of on-screen action can be 
strength. controlled by persons responsible for assessing the officials, 

Benefits of the present invention include the opportunity 65 performance. Officials can be required to move their adopted 

to visualize an instructive or ideal image of specific skills on-screen official image so as to be in the best position to see 

and maneuvers used in ice hockey. The player/student can the play and make a call when warranted. Reverse angle 


03/11/2004, EAST Version: 1.4.1 


US 6,183,259 Bl 

7 8 

views of the digitized images can be available on demand to etc., for the input of information from the user and a printer 

provide real time feedback on whether a play included a foul 208 for printing information such as player/student accom- 

or was cleanly executed. plishment information in hard-copy media. Input and output 

After viewing each specific image sequence, the official with the user can also he accomplis hed with virtual reali ty 

can enter into the computer his/her decisions regarding the 5 devices 207 such as a virtual reality glove and helmet worn 

legality of the plays previously observed. The results are %Jhs use r. A memory 210 is provided, coupled to the iJU 

compiled by the computer and fed back to the officials via 202 > for the storage of program instructions and data, 

the computer screen or by hardcopy printouts. recorded images and other information. 

The benefits of this embodiment include the opportunity Several versions of computer programs are encompassed 

for officials to practice decision making at their own pace in 10 b y the present invention. Each version varies in complexity 

a relaxed environment. As with the previous embodiments as eacn is directed toward a player/student at a different level 

of this invention, the images on the computer screen can be °f expertise. Versions developed for home, rink, and arcade 

viewed frame by frame, or at any speed from slow motion use are instructional as well as entertaining. More complex 

to real time to super real time, and repeated as many times versions for use in structured training facilities are devel- 

as desired. This will enable officials to study details which 15 °P ed - For each version, the computer system stores a series 

can be missed in the fast, high pressure setting of a hockey °f lessons and corresponding "ideal" images in a database, 

game or to test their skills in making calls at real time rates FIGS. 2A-2E contain flowcharts which illustrate the 

of speed or even faster (super) than actual playing speed. As logical flow of the computer system(s) used for the prepa- 

the officials progress in their decision-making abilities, the ration and operation of the system of the present invention, 

images which are viewed at increasingly faster speeds, either 20 FIG. 2A shows the procedure for scanning images into the 

real-time or faster, provide practice in quick orientation, computer system 200 and preparing them for display on the 

observation and judgment and thereby sharpen officiating computer screen 204. 

skills. Steps 212 and 214, images for a particular skill or 

After each image sequence has been viewed, the official maneuver are scanned into the computer system 200. Indi- 
can use means such as a computer keyboard, mouse, joystick vidual drawings are created and scanned to complete the 
or other input device to input his/her decision regarding th e sequence of the instructive "master" or "ideal" hockey 
le gality of the observed p)avs into the computer system . The player performing the skill or maneuver as well as to 
official is presented with a list of possible infractions and encompass all possible movements that the player/student- 
asked to select those infractions observed during the image 3Q controlled ("adopted") player may perform, 
sequence. Th eofficial gains points for correct judgments and After all the instructive images in a given sequence have 
lose points for incorrect judgments. At the end of the been scanned, the images can be prepared for display on the 
exercise, the computer can display a numeric score as w ell computer screen. This can be accomplished with a number 
as a list of incorrect decisi ons. The score and list can also be of commercially available computer packages, including 
pri nted in hardcopy format if desired. ^ 35 Photoshop, Photofinish, NeoPaint, Paint, Graphics Designer, 

If the user does not achieve a certain level of proficiency, and Correlpaint. In blocks 216, 218, 220, and 222, the 

he/she can be required to loop back and repeat testing on the images can be scaled or rotated, as necessary. If any images 

image sequences previously viewed before advancing to a contain unwanted elements, they can be cropped in blocks 

higher level. As with other embodiments of the invention, 224 and 226. In blocks 228 and 230, the images can be 

the computer can keep a record of the proficiency scores for 40 refined to remove unwanted lines or blotches or to add lines 

each official. Current scores may be compared to those that have faded during scanning. In blocks 232 and 234, the 

attained previously. This will enable each user to monitor images can be enhanced by adding elements such as back- 

his/her progress in perfecting his/her decision-making skills. ground or motion lines. 

The purpose of this embodiment is to accelerate the Each image is prepared in turn in the loop under control 

experience and improve the positional and judgment skills 45 of blocks 236 and 238. After each image in the sequence has 

of officials in ice hockey by increasing the number of been prepared, it can be aligned with others on the computer 

decisions made while observing actual hockey plays and screen in block 240. The preparation stage ensures that the 

maneuvers. Officials obtain practice in orientation, images can be displayed as a smooth animation sequence 

positioning, observation and judgment. Officials can when the program is run by users. All or any portion of a 

rehearse preferred positioning so as to decrease interfering 50 controllable figure can be displayed from any perspective, 

with play. Consistency and objectivity will be increased. The [ n an alternative embodiment of the invention, images 

rules of the game will be reinforced in the minds of the recorded by video tape can be used instead of the hardcopy 

officials. In addition, use of this embodiment of the invention drawings described above. In this case, video recordings are 

may also help students and players of ice hockey to learn the ma de of a particular skill or maneuver. Each frame of the 

rules and regulations of the game. 55 video tape is digitized so that it can be stored in computer 

FIG. 1 contains a block diagram of one embodiment of the files using a standard such as JPEG (Joint Photographic 
computer system 200 of the invention for simulating physi- Expert Group), MPEG (Motion Picture Experts Group), 
cal activities such as skating and hockey maneuvers and for FLI, FLC, etc. The sequence of images is refined in con- 
entertainment use according to the present invention. The nection with FIG. 2A. The result is a series of images in 
system comprises a central processing unit (CPU) 202 which 60 computer-readable form similar to those obtained from the 
can be, but is not limited to, a microcomputer such as a hardcopy drawings described above. Images need not be 
personal computer operating with an Intel 80X86 exclusively drawn images or video images; mixed images 
microprocessor, a Motorola 680X0 processor, or a Power PC may be used. Images can be obtained by videotaping an 
processor. The CPU 202 is coupled to a display 204, such as actual player performing a maneuver or by videotaping 
a CRT screen, for displaying images and prompting the user 65 performance of the maneuver by preprogrammed robots 
for fhe input of information. The fcPU 202 is also coupled to such as the robots described in co -pending U.S. patent 
an input device or devices 206 su r.h as a V p r vhnard 1 joystick^ application Ser. No. 08/375,617, filed Jan. 20, 1995, entided 
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"Mechanized Robots for use in Instruction, Training and (3) stickhandling 

Practice in the Sport of Ice and Roller Hockey," by Vincent (4) shooting 

J. Macri, which is incorporated herein by reference. Polar- 0 ff ens j ve 

ized reflective markers can be attached to the player or the * • 1 

robot to enhance the video image. Alternatively, active s ^ deten&lve P lav 

motion sensors can be used. ( 7 ) positional play 

FIG. 2B contains a flowchart showing the process of (8) situational play 

compressing the computerized files containing each (9) tactical play 

sequence of drawings to conserve storage space. The process p_Q) maneuvers. 

involves comparing each drawing to the next one in the 10 Jn b]ock 28g me pUyer/student selects the number of the 

sequence and recording only those pixel elements which category he/she wishes to study and/or practice. If the 

have changed from one drawing to the next. Other com- player/student chooses to press <ESC>, he/she will exit the 

pression techniques also exist and may be used. system in block 290. 

In blocks 250 and 252, a sequence of images is selected, For each general category, the computer system stores a 

and the number of images in the sequence is determined. 15 list or sub-menu of specific plays, maneuvers or skills which 

Beginning in block 254, with the initial image that would will develop the player/student's skills in the area selected, 

appear on the screen, each drawing is compared to the For example, under the category of skating, he/she may 

previous drawing in the sequence. In the case of the first choose from the following options: 

drawing in the sequence, the comparison is made to an ^ dasn f orW ard 

empty screen. Each pixel element which has changed from 20 ^\ dasn: backward 

one drawing to the next is identified in block 256 and the ' 

change data is compressed in block 258. The compressed yp) start 

data is then stored in a sequence file in block 260. This (4) stop 

procedure is repeated for each drawing in the sequence in (5) forward left crossover 

blocks 262 and 264. 25 ( 6 ) f orward right crossover 

Referring to blocks 266 and 268, the relationship between ^ backward left crossover 

each of the drawings is input in the form of a decision tree . , „ . L A 

j j j ■ * £i t *t c *u (8) backward right crossover 

and recorded in a computer file. In the case of the sequence ™ . 7 1 1 . * ^ 

flL , . * j 1 The sub-menu for the general category selected by the 

of the drawings representing the instructive master or ideal . , 4 - t . 1t , ,? . , . ti , ~ M i 

t . j • • * j£j 1* u-30 player/student will be displayed in block 292. and the 

image, the decision tree is defined as a linear relationship , , . j * , 4 . •« . / L ■ . 

0 . . tl c . . a . c * *u 1 * t *u player/student selects the maneuver or skill he/she wishes to 

progressing directly from the first frame to the last. In the . j - . , . r* iL L 

r f 1 ft a 4 *„n a * u r ™ * study and/or practice in block 294. If the user chooses to 

case of the player/student controlled image, each frame is ™^ . , . n . . .1 1 . .1. 

* . t c *u c press <ESC>, he/she will return via block 296 to the 

connected to a series of other frames representing the £ menu in block 286 

different ways in which the student can move the animated Ca ! r ^ i ? r ^ menu 10 oc * 

n 1 i_- 1- * l * *j- 35 If the player/student opts to study a specific maneuver or 

figure. The relationship between each interconnected image • 4 . • * • 

4uj£:j j* j ^ 1 «u j « f *u skill, the system retrieves the appropriate image sequences 

must be defined and stored. To make the definition of the ~ ' . J . A . ... A A . n „ 

j.. . . , _4f*uuj u*i from the image database in block 298. An options menu will 

decision tree easier, each part 01 the body which moves . , f . u 1 h»a r l i n 

/ . 1X Lag* 4 • * he dLsplayed in block 300. For each maneuver or skill 

(such as an arm or lee) can be defined as a separate series of . t r . ; L , # „ . , ^ * r.u 

■ r> 4* t 1 -4* 1 ■ 4 u 1 selected, the player/student can either view the images of the 

images. Composition of several partial images into a whole .« , 4 . *1 • . . 

.1 1 * j ■ 40 ideal execution of the maneuver and/or interactively practice 

can provide the completed image. At . .„ , . . A . * , . * . 

*\ „ , / .„ . , . , „ r ■ the maneuver or skill by manipulating via the user input 

r 2C L lhrou S h 2E illustrate the logical flow of the device an ad d im of a hock j wfaich has beeQ 

system of the present mvenUon that is run by the player/ superimposed over or juxta posed to the ideal image on the 

student or user. In block 270 of FIG. 2C 7 the system displays ^ (as shown m mGS 23 ^ 24) ^ n praclicing a 

an opening screen on the computer disp ay which contains 45 ^ ^ Iaycr/studcnt attcmpts to mani p U iate the adopted 

a title, logo, and welcome message. In block 272 the k . m a ximate ^ dosely as ^ ssible the 

computer requests a user identification code (ID) and, in cxccution of ^1 by the ideal image. The player/student 

block 274 the player/student enters an ID into the computer makes mis &om ^ tionR memi iQ block 302 If 

via a keyboard mouse or ottier user input device In block ^ player / studc nt chooses in block 302 to press <ESC>, 

276, the system determines if the user has entered the system 5Q he/she wm retum tQ ^ skiU menu Wock 292 via Mock 304 

before. If the player/student has previously entered the Jf ^ p i ayer / stud ent chooses, in block 306, to view the 

system, information regarding his/her personal characteris- master 0f ^ execution of ^ skiU or mmeTy of 

tics (e g. name idenUficaUon code, weight, height, age, right the m ^ tQ nG 2D Jf the player/smdent 

or left handedness level of expertise team name and choQses in bbck 3Q6 tQ tice tfae ^ 0f 

coach/instructor s Name (as shown m FIGS. 27 and 28)) as S5 maneuver> from block 306 t0 FIG 2E 

well as his/her performance record can be retrieved from the Re f erring to nG. 2D, if the player/student has chosen to 

database in block 278. If the player/student is new to the yiew ^ mastef 0f idea] im in b]odB 308 afld 310 ^ 

system, information regarding his/her personal characteris- la /student bc ms with me first im in thc ^ , If 

Ucs can be recorded by the system m blocks 280 and 282. If ^ player/student chooses in block 312 t0 press es C the 

the player/student has entered an invalid ID, the system can 6Q stem win ntm ^ block m tQ ^ ions menu fn 

return to the input stage via block 274 after informing the block 300 (see FIG 2C) 

user in block 284. [f tfae playcr / stxidcnt chooses in block 316 to view the 

Following the identification process, the player/student is previous frame in the sequence, the system checks in block 

presented with, in block 286, a menu of general categories 318 to insure mat a p re vious image exits, i.e., that the 

which describe the skills used in the sport of hockey, e.g. 65 p i ay er/student is not currently viewing the first image in the 

(1) skating sequence. If a previous frame exists, the system selects and 

(2) checking displays the appropriate image in blocks 320 and 322. 
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If the player/student chooses in block 316 to view the next 
frame in the sequence, the system checks in block 324 to 
insure that a subsequent image exists, i.e., that the player/ 
student is not currently viewing the last image in the 
sequence. If a subsequent frame exists, the system selects 5 
and displays the appropriate image in blocks 326 and 328. 

Referring back to FIG. 2C, as mentioned above, if the 
player/student chooses in block 306 to practice the selected 
skiU or maneuver, control passes to FIG. 2E. Referring to 
FIG. 2E, in block 330, the decision tree which describes the 
relationships between the drawings in the player/student 10 
controlled image sequence is retrieved. In block 332, the 
first image which will be displayed on the computer screen 
is determined and retrieved. In blocks 334 and 336, the first 
image in the master sequence, the first image in the player/ 
student controlled sequence, the fixed image (or 15 
background), and the proficiency display graphics are com- 
bined and displayed. 

In block 338, the player/student may exit to the options 
menu via block, 340 or select a computer key (or other input 
device, e.g. mouse, joystick) which will move the controlled 
image. If the player/student selects an invalid key, the 20 
system will give the player/student the option of selecting 
another key in block 342. 

If the player/student selects a key to manipulate the 
controlled image, the next frame in the sequence will be 
selected in block 344. The controlled image will be updated 25 
in block 346 and proficiency measurements will be calcu- 
lated in block 348. The system will then return to block 334 
where the images will be combined and displayed. 

While practicing the skill or maneuver, the player/student 
receives visual feedback by studying on the computer screen 
(monitor) how closely the adopted image approximates the 30 
ideal image. In addition, proficiency measurements are 
calculated and displayed on the computer screen together 
with the master and controlled images. The proficiency 
measurements can be continuously updated as the player/ 
student proceeds through the practice session. 35 

If the player/student chooses in block 340 to return to the 
options menu, the system can calculate a numeric score or 
scores in block 350 which will represent how close the 
player/student came to approximating the ideal image. If 
applicable, the system can compare current results to those 
retrieved from the player/student's records. This will enable 40 
him/her to monitor his/her progress in perfecting the par- 
ticular skill being studied. This information will be dis- 
played on the computer screen in block 352. 

If the player/student chooses in block 354 to count the 
practice session as a "warm-up", the current score will not 45 
be recorded in the player/student's record. Otherwise, the 
player/student's current performance will be recorded in 
block 356 by the computer for future reference. Control of 
the system then returns to FIG. 2C. 

In a further embodiment of the invention, the player/ 50 
student has the option of controlling the adopted image of 
one or more hockey players against an opposing team in the 
context of a game (this embodiment of the invention can be 
used for practice sessions or drills). The opposing team may 
consist of one to five ideal players (plus one goaltender) that 55 
are controlled by the computer system. 

The player/student can select the number of players (one 
to six including goaltender) on the opposing team from a 
menu screens (as shown in FIGS. 15 and 18). In addition, the 
player/student has the option of choosing whether the oppos- 
ing team is in an offensive or defensive posture (as shown in 60 
FIG. 13), 

Hie player/student can then choose from a list of attack- 
ing or defending formations for the opposing team. The list 
of formations can vary with the number of players on the 
opposing team, it being obvious that a full team of six (5 65 
skaters and one goalie) will offer the maximum number of 
formations (as shown in FIG. 14). 


The game can be played with the player/student causing 
the movement of the adopted image(s) to "play" against the 
ideal team which is pre-controlled by the computer software. 
The rules of the game will be those generally used in 
competitive hockey, i.e. by most American, Canadian, and 
international teams. Games can last from 10 to 45 minutes 
(more or less) depending on the delivery system being used, 
e.g. tutorial/interactive, coaching, arcade, home, etc. 

Additional embodiments of the invention enable the 
player/student to play against an opposing team when his/ 
her adopted image is part of an adopted team. Each team 
may consist of ideal (computer controlled) images or 
adopted images controlled by other player/students on addi- 
tional terminals connected to the system or networked 
together. Each team may consist of one to five players (plus 
goalies), with fewer players for roller hockey; and more or 
less for other sports or activities. 

FIGS. 3 through 8 are schematic pictorial illustrations of 
use of the various embodiments and configurations of the 
present invention. 

FIG. 3 shows a single user using the invention. The user 
supplies inputs via a hand-held joystick to manipulate an 
adopted fipTJ re on the riphtside or the screen to approx imate 
movement of an image of an instructive, preprogrammed 
figure on the left side of the screen. The user views the 
preprogrammed image, recognizes what is being 
demonstrated, visualizes the performance of the maneuver, 
makes cognitive choices and decisions (including consider- 
ing options) then manipulates the controllable, adopted 
image on the right side of the screen to achieve the instructed 
desired result. 

FIG. 4 shows another single user interfacing with the 
computer system of the invention. In this embodiment, the 
user, in a competitive setting, manipulates the controllable 
image ( sjjpwn connected to tne tovsiick controller 1 bV a 
dashed line) to effect a result or accomplish an objective 
playing in opposition to two preprogrammed images. It will 
be understood that the number of preprogrammed and 
controllable images can be different than those depicted in 
FIG. 4. 

FIGS. 5A and 5B show two users using the invention 
simultaneously on two different computers which are net- 
worked together. In this configuration, two instructive 
images on the left side of the screen are approximated by 
two adopted, controllable images on the right side of the 
screen. The first user (FIG, 5A) manipulates one of the 
adopted figures to emulate a repositioning movement of one 
of the instructive figures, and the second user (FIG. 5B) 
manipulates the other adopted figure to emulate the reposi- 
tioning of the other instructive figure. 

FIG. 6 shows multiple users simultaneously interfacing 
with the method and apparatus of the invention on multiple 
networked computers. In this configuration, multiple users 
manipulate controllable images in a team setting against a 
preprogrammed team, with each user controlling one of the 
five controllable figures. Alternatively, the system can be 
used such that the opposing team is also comprised of 
controllable images. 

FIG. 7 is a pictorial view showing multiple users inter- 
facing with the invention. Again, the individual computers 
are networked such that all of the users can interface with the 
invention simultaneously. In this embodiment, the system is 
installed in a skating rink setting such that it is conducive to 
practice and training. The skating rink can be of the type 
described in co-pending U.S. patent application Ser. No. 
08/375,606, filed Jan. 20, 1995, entitled "Interactive Ice and 
Roller Hockey Training Coaching and Playing Rinks/' by 
Vincent J. Macri, which is incorporated herein by reference. 

FIG. 8 is a schematic pictorial depiction of the invention 
being used by multiple users simultaneously with the sys- 
tems being connected over the worldwide Internet. This 
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configuration allows users remotely located from each other 
to simultaneously interface with the invention and with one 
another. 

While this invention has been particularly shown and 
described with references to preferred embodiments thereof, 
it will be understood by those skilled in the art that various 
changes in form and details may be made therein without 
departing from the spirit and scope of the invention as 
defined by the appended claims. 

The foregoing describes the use of the system of the 
present invention for cognitive instruction, simulation, pre- 
training and practice and entertainment in the sport of ice 
hockey. However, as will be recognized by those of ordinary 
skill in the art, the system of the present invention may be 
utilized for other sports or athletic training, including, but 
not limited to, street hockey, roller hockey, field hockey, 
figure skating, soccer, football, baseball, etc., or instruction 
in other non-sport activities. For example, for sports the 
system of the present invention may be utilized in an 
instructional program for soccer by storing images of ideal 
soccer plays and allowing the player/student to control an 
image of a soccer player in the manner described previously 
for ice hockey. For non-sport activities, such as bricklaying, 
diamond cutting etc., calling for the coupling of cognitive 
and motor skills the present invention is well-suited. 

It will also be apparent to those skilled in the art that the 
scope of the present invention need not be limited to the 
technology described above. For example, the method used 
by the player/student to manipulate the "controlled" image 
may be changed to include a joystick, 3D controller for PC 
games such as SpaceOrb 360, virtual reality gloves (as 
shown in FIG. 21), rHrrrt irri c jTiiln g i f""Hr°i1nln nr nther 
technology and the "adopted" and "instructive" images may 
appear on a virtual reality headset (as shown in FIG. 22) or 
other virtual reality device(s). The method of obtaining, 
storing, and displaying the "controlled" and "instructive" 
images may also be changed to include video, multi-media, 
or animation methods. All or any portion of a controllable 
figure can be displayed from any perspective. 

What is claimed is: 

1. A method of simulated training for at least one user 
interacting with at least one image displayed on a display 
means of a processing system, said method comprising the 
steps of: 

generating and storing in a memory means of the pro- 
cessing system, at least one processor displayed 
sequence of demonstrative images, wherein said at 
least one processor displayed sequence of demonstra- 
tive images comprises a series of images of demon- 
strative performance of physical activity movements; 

further generating and storing, in said memory means, at 
least one processor displayed user controllable image, 
wherein said at least one processor displayed user 
controllable image comprises a user controllable image 
idiosyncratically controlled by said user to perform a 
series of simulated physical activity movements idio- 
syncratic interactive with said sequence of demonstra- 
tive images; 

displaying an image of said sequence of demonstrative 
images on the display means of said processing system; 

further displaying said user controllable image on said 
display means of said processing system, 

providing said at least one user with input means of said 
processing system to transmit inputs to said processing 
system for idiosyncratically controlling said user con- 
trollable image, such that instead of said at least one 
user performing said interactive movements, said user 
controllable image is controlled to perform said simu- 
lated physical activity movements idiosyncratically 
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interactive with said displayed image of said sequence 
of demonstrative images; 

storing, and maintaining in said memory means, a record 
of said movements representing said user controllable 
image as controlled by said input means such that said 
record is modified to represent said idiosyncratic move- 
ments as controlled by said input means; and 

displaying said movements of said user controllable 
image on said display means in sequence with said 
displayed image of said sequence of demonstrative 
images. 

2. The method of claim 1 further comprising the step of 
providing means, to said at least one user, to select from 
examples of said demonstrative physical activity move- 
ments. 

3. The method of claim 1 further comprising the step of 
providing means to receive inputs from said at least one user 
to select the speed at which said series of images of 
demonstrative performance of said movements is displayed. 

4. The method of claim 1 further comprising the step of 
providing means to coordinate the speed of use of said input 
controls from said at least one user with the speed at which 
said series of images of user controllable movements is 
displayed. 

5. The method of claim 1 further comprising the step of 
providing means to receive inputs from said at least one user 
to control the speed at which the user controllable image is 
caused to move. 

6. The method of claim 1, wherein said user controllable 
image is displayed in a region of said display means that is 
adjacent to another region of said display means at which 
said series of images of demonstrative movements is dis- 
played. 

7. The method of claim 1, wherein said user controllable 
image is superimposed upon the series of images of said 
demonstrative movements. 

8. The method of claim 1 further comprising the step of 
providing means to receive inputs from said at least one user 
to control the direction of movement of said user control- 
lable image. 

9. The method of claim 1 further comprising the step of 
receiving input from said at least one user to control the 
location of said user controllable image. 

10. The method of claim 1 further comprising the step of 
receiving input from said at least one user to control the 
locomotion of said user controllable image. 

U. The method of claim 1 further comprising the step of 
providing means to receive inputs from said at least one user 
to control the posture of said user controllable image. 

12. The method of claim 1 further comprising the step of 
providing means to receive inputs from said at least one said 
user to control the distance between said at least one user 
controllable image and at least one other user controllable 
image. 

13. The method of claim 1 further comprising the step of 
providing means to receive inputs from said at least one user 
to control at least one item used in said simulated physical 
movement activity by said at least one user controllable 
image. 

14. The method of claim 1, wherein said series of simu- 
lated physical activity movements comprises a maneuver of 
said movements. 

15. The method of claim 1, wherein said input means 
comprises a virtual reality input device. 

16. The method of claim 1, wherein said display means 
comprises a virtual reality display device. 

17. The method of claim 1, wherein said series of images 
of demonstrative performance of said movements comprises 
a first maneuver; and said input means provides input, by at 
least one said user, to control at least one said user control- 
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lable image to move in performance of a second maneuver 
to interact with the first maneuver. 

18. The method of claim 17, wherein said series of images 
of demonstrative performance of said movements comprises 
a first maneuver, and said input means provides input, by at 
least one said user, to control at least one said user control- 
lable image to move in performance of a second maneuver 
in opposition to the first maneuver. 

19. The method of claim 17, wherein said series of images 
of demonstrative performance of said movements comprises 
a first maneuver; and said input means provides input, by at 
least one said user, to control at least one said user control- 
lable image to move in performance of a second maneuver 
in cooperation with the first maneuver. 

20. The method of claim 1, wherein said user controls 
movement of said at least one user controllable image to 
substantially respond to the movements of said displayed 
series of images of demonstrative performance of said 
movements. 

21. The method of claim 1 further comprising the step of 
displaying visible communications to said at least one user. 

22. The method of claim 1 further comprising the step of 20 
emitting audible communications to said at least one user. 

23. The method of claim 1 further comprising the step of 
providing alphanumeric communications to said at least one 
user. 

24. The method of claim 1, wherein said at least one user 
further controls at least one additional user controllable 25 
image. 

25. The method of claim 1 further comprising at least one 
additional remotely located user to control at least one 
additional user controllable image. 

26. The method of claim 1, wherein said series of simu- 
lated physical activity movements comprises simulated 
training for at least one of real physical movements and 
unreal physical movements. 

27. The method of claim 1, wherein said at least one user 
selects to substantially suspend from being displayed said 
displayed image of said sequence of demonstrative images. 

28. The method of claim 1, wherein said at least one user 
selects to substantially suspend from being displayed said 
displayed image of said user controllable image. 

29. The method of claim 1, wherein said at least one user 
selects to substantially suspend said inputs to said process- 
ing system. 

30. The method of claim 1, wherein the displayed image 
of said user controllable image is modified according to user 
specifications. 

31. The method of claim 1, wherein the displayed image 
of said user controllable image is modified according to 
movements of said user controllable image. 

32. The method of claim 1 further comprising the step of 
providing means to said at least one user to select bio me- 
chanical parameters of said series of images of demonstra- 
tive movements. 

33. The method of claim 32, wherein said at least one user 
is a physically challenged user controlling movement of at 
least one part of the virtual body of said user controllable 
image without moving a corresponding part of said physi- 
cally challenged user's body. 

34. The method of claim 1, wherein said at least one user 
controls at least one part of the virtual body of said at least 
one user controllable image without moving a corresponding 
part of the user's body. 

35. The method of claim 1, wherein said series of images 
of demonstrative movements are displayed in the foreground 
of said user controllable image. 

36. The method of claim 1, wherein said series of images 
of demonstrative movements are displayed in the back- 
ground of said user controllable image. 

37. The method of claim 1, wherein the process of said at 
least one user idiosyncratically interacting with said at least 
one image is communicated to at least one other remotely 
located user. 


38. The method of claim 1, wherein said at least one 
displayed sequence of demonstrative images comprises a 
series of images of objects representing said demonstrative 
movements. 

39. The method of claim 1, wherein said displayed 
sequence of demonstrative images is responded to by user 
input controls to said processing system such that said at 
least one user's idiosyncratic controls are displayed as 
simulated responses made by said at least one user in the first 
person. 

40. The method of claim 1, wherein said demonstrative 
image is comprised of a physical device. 

41. The method of claim 1, wherein said user controllable 
image is comprised of a physical device. 

42. The method of claim 1, wherein said displayed 
sequence of demonstrative images is displayed on a holo- 
graphic display. 

43. The method of claim 1, wherein said displayed 
sequence of user controllable images is displayed on a 
holographic display. 

44. The method of claim 1, wherein said demonstrative 
image is a member of a group comprised of at least one live 
image. 

45. The method of claim 44, wherein two such said groups 
compete against one another. 

46. The method of claim 1, wherein said user controllable 
image is a member of a group comprised of at least one live 
image. 

47. The method of claim 46, wherein two such said groups 
compete against one another. 

48. The method of claim 1, wherein prior user inputs to 
said processing system to control said user controllable 
image are stored in said memory means of said processing 
system. 

49. The method of claim 48, wherein said stored inputs 
are selected by said user such that said user controllable 
image performs said movements as controlled by said stored 
memory inputs without further inputs from said user. 

50. The method of claim 1, wherein at least one said user 
controllable image performs at least one said simulated 
movement that is independent of said at least one user's 
control. 

51. The method of claim 1, wherein said demonstrative 
40 image uses a representation of a real item used in an activity 

representing said movements. 

52. The method of claim 1, wherein said demonstrative 
image uses a representation of an unreal item used in an 
activity representing said movements. 

53. The method of claim 1, wherein said user controllable 
45 image is displayed using a real item in an activity repre- 
senting said movements. 

54. The method of claim 1, wherein said user controllable 
image is displayed using an unreal item in an activity 
representing said movements. 

55. The method of claim 1 further comprising the step of 
evaluating by processing system means of said processing 
system, said simulated movements of said user controllable 
image with said sequence of demonstrative images. 

56. The method of claim 55 further comprising the step of 
generating a processing system performance analysis of the 
user controllable image based on the result of said evalua- 
tion by said processor means. 

57. The method of claim 1, wherein the processing system 
provides tactile feedback to said at least one user, 

58. The method of claim 1, wherein said user controllable 
image is controlled by said user to perform a demonstrative 
performance of said physical activity movements. 

59. The method of claim 1, further comprising allowing 
said user to control said user controllable image by voice 
inputs. 

60. The method of claim 1, wherein said at least one of the 
demonstrative images and said at least one of the user 
controllable images are displayed in the same aspect. 
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61. The method of claim 1, wherein the characteristic 
parameters of said at least one of said demonstrative images 
are selected by said user. 

62. The method of claim 1, wherein the characteristic 
parameters of said at least one of said user controllable 
images are selected by said user. 

63. An article of manufacture comprising a processing 
system user medium having processor readable information 
embodied therein which evaluates a processing system dis- 
played series of image sequences with a processing system 
displayed series of user idiosyncratically controlled image 
sequences comprising; 

means for generating a first sequence of processing sys- 
tem displayed images, said sequence comprising a 
series of discrete movements of at least one image as 
displayed by said processing system readable informa- 
tion; 

means for receiving said processing system controlled 
sequences, said sequences representing the processing 
system user's response to said processing system dis- 
played first sequence; and 

means for evaluating said first and second sequences, and 
wherein said evaluation produces a result, said result 
providing an indication of the processing system user's 
demonstrated skill at responding to said first sequence. 

64. A processing system for simulated training for at least 
one user interacting with said processing system comprising: 

a first memory means for storing at least one processing 
system displayed sequence of demonstrative images in 
a series, wherein said series of at least one of said 3Q 
processing system displayed sequence of demonstra- 
tive images comprises a series of pre-recorded images 
illustrating performance of physical activity move- 
ments; 

a second memory means for storing at least one process- 35 
ing system displayed user controllable image in a 
series, wherein said series of at least one computer 
displayed user controllable image comprises images 
derived from biomechanical parameters and controlled 
by at least one user to perform a series of idiosyncratic 40 
simulated physical activity movements responsive to 
the movements of said series of idiosyncratic images of 
demonstrative performance of the activity; 

display means for displaying said series of images of 
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said data related to controlled movement of said user 
controllable image. 

65. The processing system of claim 64, wherein said input 
means comprises a virtual reality input device, 

66. The processing system of claim 64, wherein said 
display means comprises a virtual reality display device. 

67. The processing system of claim 64, wherein said 
series of at least one user controllable image performs at 
least one simulated physical activity movement that is 
independent of the said user's control. 

68. Amethod of simulated training for at least one user to 
interact with at least one image displayed on a display means 
of a processing system, said method comprising the steps of: 

recording and storing in a memory means of a processing 
system, a first series of discrete images, said discrete 
images collectively comprising a sequence of physical 
activity movements; 

further recording and storing in a memory means a second 
series of discrete images collectively comprising a 
sequence of idiosyncratic simulated physical activity 
movements responsive to said first series of discrete 
images; 

displaying, on a display means of said processing system, 
at least one of said discrete images in said first series, 
said displayed image comprising a first displayed 
image; 

further displaying on said display means, at least one of 
said discrete images in said second series, said dis- 
played image comprising a second displayed image; 

sequentially displaying the next discrete images in said 
first series; 

receiving input from at least one user to control said 
second displayed image to substantially interact with 
said first displayed image instead of said at least one 
user performing said interactive movements to said first 
series of discrete images displayed during said sequen- 
tially displaying step; and 

providing means for said at least one user to evaluate said 
second displayed images with said first displayed 
images, thereby said user being instructed to learn said 
movements interactive with said sequentially displayed 
discrete images in said first series. 

69. The method of claim 68 further comprising the step of 


providing processing means of said processing system to 
demonstrative performance of the activity with said 45 evaluate said control of said second displayed images inter- 
series of user controllable images; acting with said first series of discrete images in order to 
input means, used by said at least one user, for transmit- provide the result of the evaluation to said at least one user, 
ting input to said processing system to cause a series of 70. The method of claim 68, wherein said processing 
user controllable images to perform a series of idio- system displayed series of image sequences of first discrete 
syncratically controlled, simulated physical activity so movements is comprised of images of live activity. 


movements interactive with said movement of said 
series of images of demonstrative performance of the 
activity, without said user making corresponding 
movements, wherein said input comprises data control- 
ling said movement of said user controllable image; 55 
and 

processing system means for storing said input from said 
at least one user in a third memory means; said pro- 
cessing system means for controlling said display 
means to display said series of images of demonstrative 
performance of the activity and said series of user 
controllable images, for retrieving said stored input 
from said third memory means, for providing said at 
least one user with means to evaluate said movement of 
said series of user controllable images with said move- 
ment of said series of images of demonstrative perfor- 
mance of the activity, and for displaying the results of 


60 


65 


71. A processing system product usable with a program- 
mable processor having processor readable information 
embodied therein which interactively obtains a sequence of 
processing system user input controls comprising: 

processing system readable information which comprises 

at least a base set of displayable images; 
processing system readable information which generates 
a sequence of various positions of one or more of said 
base set of displayable images; 
processing system readable information which comprise 
at least one displayed template of said at least display- 
able image which enables image input controls by said 
processing system user, said image input controls rep- 
resenting a user's idiosyncratic interaction with said 
processing system information generated sequence; 
wherein a user's demonstrated skill is determined based 
on an evaluation of said processing system user image 
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input controls sequence to said 
information generated sequence. 

72. The processing system program information product 
of claim 71, wherein said base set of displayed images 
comprises live activity. 

73. The processing system program information product 
of claim 71, wherein said product comprises capability for 
distributed operation. 

74. A method of interactively determining a processing 
system user's demonstrated skill based on said user's inter- 
action with one or more processing system displayed 
images, said method comprising; 

providing a training sequence of discrete movements of at 
least one displayed image, said training sequence addi- 
tionally comprising at least one of audible, alphanu- 
meric and visual communication; 

providing a processing system user with a displayed 
representation of said one or more displayed images; 

accepting user input controls representing said processing 
system user's idiosyncratic interaction with said train- 
ing sequence; and evaluating said user input controls to 
said training sequence, scoring said evaluation, said 
scoring representing said processing system user's 
demonstrated skill. 

75. The method of claim 74, wherein a multimedia 
method of interactively determining a processing system 
user's demonstrated skill is based on said user's interacting 
with input controls in said training sequence. 

76. A method of improving a processing system user's 
simulated training skills based on interaction with one or 30 
more processing system displayed images, said method 
comprising: 

providing a training sequence of discrete movements of 
one or more displayed images, said training sequence 
representing at least one movement; 

providing a processing system user with a displayed 
representation of said one or more displayed images; 

accepting idiosyncratic user input controls representing 
said processing system user's response to said at least 
one movement; 

evaluating said user input controls to said training 
sequence, scoring said evaluation, said scoring repre- 
senting said processing system user's demonstrated 
skill in interacting with said at least one movement. 

77. The method of claim 76 wherein improving a pro- 
cessing system user's simulated training skills comprises 
said at least one movement which represents at least one of 
a coaching and training decision. 

78. A method of simulated training for a least one user 
using personal, interactive, idiosyncratic, physical move- 
ment to control at least one image displayed by a processing 
system, said method comprising the steps of: 

generating and storing in a memory means of said pro- 
cessing system, at least one processor displayable 
sequence of demonstrative images, wherein said at 
least one processor displayable sequence of demonstra- 
tive images comprises a series of images of demon- 
strative performance of physical movements; 

further generating, storing and maintaining in said 
memory means, at least one processor displayable user 


controllable image, wherein said at least one processor 
displayable user controllable image comprises a user 
idiosyncratically controllable image controlled by said 
user so as to perform a sequence of personal, 
interactive, idiosyncratic, simulated physical move- 
ments interacting with said sequence of demonstrative 
images; 

displaying an image of said sequence of demonstrative 
images on a display means of said processing system; 
further displaying said user controllable image on said 

display means of said processing system, 
providing said at least one user with input means of said 
processing system to transmit inputs to said processing 
system for controlling said user controllable image, 
such that instead of displaying the movement of said at 
least one user performing said movement, said user 
controllable image is controlled to perform said move- 
ments interactive with said displayed image of said 
sequence of demonstrative images; 
storing and maintaining in said memory means, move- 
ments representing said user controllable image as 
controlled by said input means; 
displaying said simulated physical movements of said 
user controllable image on said display means with said 
displayed image of said sequence of demonstrative 
images; and 

providing said at least one user with means to compare 
said movement of said user controllable image to said 
displayed image of said sequence of demonstrative 
images, thereby said user being instructed to leam said 
simulated movements interactive with said displayed 
image of said sequence of demonstrative images. 

79. The method of claim 78, wherein said sequence of 
images of demonstrative performance of an activity is 
comprised of images of at least one of live images or 
videotaping images or animated or computer generated 
images of at least one of things, objects or systems. 

80. The method of claim 78, wherein said at least one user 
controllable image is comprised of an image of said at least 
one of live images or videotaping images or animated or 
computer generated images of at least one of things, objects 
or systems. 

81. The method of claim 78, wherein said user control- 
lable image is idiosyncratically controlled by the user to 
perform a demonstrative performance of said movements. 

82. The method of claim 78, further comprising allowing 
said user to control said user controllable image by voice 
inputs. 

83. The method of claim 78, wherein said at least one of 
the demonstrative images and said at least one of the user 
controllable images are displayed in the same aspect. 

84. The method of claim 78, wherein the characteristic 
5 5 parameters of said at least one of said demonstrative images 

are selected by the user. 

85. The method of claim 78, wherein the characteristic 
parameters of said at least one of said user controllable 
images are selected by the user. 
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